Central limit theorem for anomalous scaling due to correlations 
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We derive a central limit theorem for the probability distribution of the sum of many critically 
correlated random variables. The theorem characterizes a variety of different processes sharing 
the same asymptotic form of anomalous scaling and is based on a correspondence with the Levy- 
Gnedenko uncorrelated case. In particular, correlated anomalous diffusion is mapped onto Levy 
diffusion. Under suitable assumptions, the nonstandard multiplicative structure used for construct- 
ing the characteristic function of the total sum allows us to determine correlations of partial sums 
exclusively on the basis of the global anomalous scaling. 
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The central limit theorem (CLT) for sums of indepen- 
dent random variables |lj plays a fundamental role in 
statistical physics. This theorem is essential for the con- 
struction of equilibrium statistical mechanics 0, under- 
lies the description of Brownian diffusion and pro- 
vides justification to numerical approaches like Monte 
Carlo methods. According to it, the probability den- 
sity functions (PDF) of the sums are Gaussian when the 
single variable PDF's have finite second moment. If on 
the other hand these PDF's have long-range tails deter- 
mining the divergence of the second moment, the Levy- 
Gnedenko limit theorem states that the sums are Levy 
distributed [J H[. There are however many situations, 
like critical phenomena in statistical systems finan- 
cial time series [(|, anomalous transport 0], and protein 
dynamics [8j], where the presence of strong correlations 
leads to non-Gaussian PDF's obeying anomalous scaling 
with finite second moment Q. Understanding how cor- 
relations determine anomalous scaling and universality is 
still a challenge in general, at least outside equilibrium 
statistical mechanics. Indeed, in this context renormal- 
ization group (RG) methods opened the way to a proba- 
bilistic interpretation of scaling and universality in crit- 
ical phenomena [l(|. RG transformations for effective 
Hamiltonians provide a framework for the discussion of 
critical scaling in cases when, due to the lack of inde- 
pendence, the simple factorization of individual variable 
characteristic functions (CF) on which the CLT is based, 
does not hold. This framework requires new and more 
complicated forms of limit theorems and stability criteria 
[lOj . In view of the key role played by the CLT in many 
fields, it is legitimate to ask if some form of CF's factor- 
ization helps in discussing the correlated case. This could 
allow us to establish parallels between the treatments of 
independent and strongly dependent variables. 

In this Rapid Communication we show that a nonstan- 
dard factorization of summand variable CF's allows one 



to construct the CF of the sum consistent with the as- 
sumption of asymptotic anomalous scaling. This factor- 
ization is at the basis of a novel CLT and, under further 
conditions, allows one to reconstruct the correlations of 
the asymptotic process. 

In many physical situations, as one considers the sum 
X = ^2ia—i Xi of stochastic variables Xi with values Xi 
in the real axis, it is observed that for large N the PDF 
of A, px(x), asymptotically obeys a simple scaling: 



N D p x (x)~g 



(n d ) 



(1) 



where g is a scaling function and D is a scaling exponent. 
The scaling is anomalous if g is not a Gaussian function or 
D =/= 1/2. As appropriate in most physical applications, 
we consider cases in which px has finite second moment. 
The Aj's and X could be, respectively, the spins and the 
total magnetization of a critical ferromagnetic system. 
They could also represent the hour by hour increments 
and the total variation of a return in a financial time 
series which is sampled on intervals of N hours. Self- 
similarity is implied by Eq. ([1]) since plots of N D px 
vs x/N D at different N asymptotically collapse onto the 
same curve g. To make this idea more precise, one can 
consider the normalized sum Y = 53 i=1 Xi/N D , and its 
PDF py(v) = Pn{v)- From Eq. ([TJ) follows then, in the 
limit N — > oo, 



pn{v) ~ g(y)- 



(2) 



For the CF of p N , p N (k) = f+™ exp(iky)p N (y)dx, Eq. 
© reads 



PN(k) ~ g(k), 



(3) 
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where g is the Fourier transform (FT) of g (pjv(O) = 
g(0) = 1). We assume here that px is even in y, so 
that px(—k) = Pjy-(fc) = px(k). Furthermore, pjv(fc) = 
1 — a 2 k 2 /2 + 0(k ), where the coefficient of k 2 is twice 
the second moment of px- Below, we choose units such 
that cr 2 /2 = f . 
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If we consider independent and identically distributed 
Xi's, the CLT accounts for the asymptotic scaling in Eqs. 
(|2|3j) stating that it is not anomalous, i.e. it has D = 1/2 
and g Gaussian. Let us call p± the PDF of any individual 
Xi and pi the corresponding CF. By TV-times convolu- 
tion, one gets 



p N (k) = [Mk/N 1 ' 2 )] 



N 



(4) 



One can prove [l[ that pN becomes Gaussian 
(~ exp(— k 2 )) at large N for any p\ with finite variance 

Pi(x)x 2 dx = 2. Via inverse FT this implies a Gaus- 
sian form for the asymptotic pn and D = 1/2. A key 
concept here is that the limit PDF of the sum is stable, 
i.e. the sum of two independent Gaussian distributed 
variables is still Gaussian distributed. This stability can 
be represented, e.g., by an invariance of g under multi- 
plication: 



g(k/2^)g(k/2^) = g(k) 



(5) 



This functional relation directly follows in the large N 
limit from Eqs. (|3|4p and has g{k) = exp(— k 2 ) as only 
possible solution. 

Here we investigate the possibility of a generalization 
of the multiplicative structure in Eq. (|5|) through the 
following steps: (i) We assume the existence of a g and 
a D characterizing a given form of asymptotic anoma- 
lous scaling; (ii) We then introduce, in terms of g and D 
themselves, a generalized multiplication ® such that the 
identity 



~g{k/2 IJ )®~g{k/2 u ) = ~g{k); 



(6) 



holds; (iii) Eventually, we apply this generalized multi- 
plication ® to CF's different from g in order to prove a 
CLT implying the existence of a wide class of correlated 
processes asymptotically behaving consistently with the 
scaling specified by g and D. 

We consider scaling functions with the additional prop- 
erty of g being strictly monotonic in [0, +oo) [llj |, which 
in our context also implies < g(k) < 1 Vfc G R. For 
a-1,0-2 £ (0,1], the generalized multiplication allowing 
satisfaction of Eq. ^ is 



g({[9-Hai)] h + [r 1 M] i } J 



(7) 



where g^ 1 is the inverse of g in [0, +oo). One can eas- 
ily verify that a\ (£> a 2 G (0, 1], a\ (g) 1 = oi, and that <g> 
is associative and commutative jl3(. Eq. (JSJ) is recov- 
ered by putting a\ — a 2 = g(k/2 D ). It is important to 
remark that if 5 is Gaussian and D = 1/2 the ® multi- 
plication reduces to the ordinary one. The consideration 
of ai ^ a 2 in Eq. ([7]) is clearly not needed to recover 
Eq. (6), but becomes of crucial importance to determine 
joint probabilities for partial sums of the Xj's compatible 
with the anomalous scaling of the total sum [l2j • 

One can further establish a precise correspon- 
dence between this generalized multiplication and 



the ordinary one. Once fixed g and D, let 
us consider the mapping M. g ,D ■ (0, 1] — * (0, 1] de- 
fined as M. 9 .d{ ) = cxp ^— [<7 -1 (0] and its inverse 



i-D 



Mg £>(■) = g [[— ln(')] ) ■ Eq. © can then be rewritten 



M,, r ,{M:,n [g(k/2 D )] ■ M- g , D [g(k/2 D )]} = 
= M^ D {M S , D [g(k)]} , 



(8) 



which exemplifies the fact that M g ,D establishes an iso- 
morphism between the generalized and the ordinary mul- 
tiplications. A key consequence is that g = M.g,D{g) 
obeys a condition of the form §5§ with the exponent 1/2 
replaced by D. This is the well known Levy-Gnedenko 
stability condition for independent random variables, 
which has the singular Levy CF, exp (^—\k\ 1 ^ D ^, as solu- 
tion [H,|3]. Consistently, of course, g(k) = exp (— Ifcl 1 /- ). 
Notice that the Levy stable g~ looses the meaning of CF 
for D < 1/2, because the corresponding PDF ceases to 
be positive definite. Here this limitation does not apply, 
since the inverse FT of g does not represent a PDF. 

According to the Levy-Gnedenko limit theorem [l|, the 
Levy stable CF is approached in the N — > 00 limit for 
the sum of N independent variables whose individual CF 
has the same leading sing ularity - Ik] 1 / at k = 0. This 
circumstance and the above mapping suggest to look at 
the counterpart of such convergence process in the space 
of correlated PDF's. In analogy with the independent 
case (Eq. Q), we can indeed construct the CF of the 
sum of correlated variables, starting from a single- 
variable CF pi , but replacing the ordinary multiplication 
with the generalized one, as specified by the chosen g and 
D. As before, p\ is assumed to be regular and to generate 
a finite second moment, but in general will not coincide 
with g. If we posepi = M,g,n($>i) this function is singular 
at k = 0: pi = 1 - + 0{\k\ 2 ' D ). Hence, by the 

Levy-Gnedenko limit theorem, [pi(k/N D )] N ~ g(k) = 
exp(-|fc| 1/jD ) for A —> 00 [3,[|. The above isomorphism 
guarantees then that [T3| 



Pi 



N D J 



g(k) 



N tern 



for N — > 00 and for any p\ with finite variance a 2 = 2. 
Eq. ([9]) follows from the fact that M^^Cg) = g and ex- 
presses a CLT for general g and D. Starting from a single 
variable PDF px, the iterated generalized multiplication 
of its CF yields the CF for the sum of the variables in 
a process where the Xj's are correlated. In force of the 
CLT, this process leads asymptotically to the universal 
anomalous scaling specified by g and D. 

The validity of Eq. ©, does not require D > 1/2 
because again the inverse FT of pi is not constrained 
to remain positive. However, other positivity require- 
ments can pose limits on the choice of p\ . Indeed, there 
is no guarantee that, if p\ is a CF, p\ ® p\ will also 



p x (a) P x (b) 




FIG. 1: Gaussian p x and D = 0.9. Plot of p x for N — 2 k , k — 
0, 1, 2, 3 (a), and k — 4, 5, 6, 7 (b). As iV increases, the central 
peak of px decreases. The rescaled plots for k = 0, 1, . . . , 7 
have increasing peaks and reveal convergence for large N: (c) 
and (d). 

be, in general. Since positivity control is a hard math- 
ematical issue [H, we addressed it numerically by 
analyzing the convergence process in Eq. ^ for sev- 
eral g's and pi's. We verified that as long as p~\ has 
the same general properties assumed for g, pn{v) = 
(l/27r) exp(— iky){pi(k /N D )]® N dk remains positive 
definite for any N. For illustration we report the results 
for the case g(k) = 1/(1 + k 2 ), i.e., g(y) — exp(— \y\)/2 
and g- x {a) = -y/l/a- 1 for a G (0,1]. Fig. □ and 
[2] show the evolution of px(x) under the generalized 
multiplications of the single variable CF for a Gaussian 
Pi{x) — exp(— x 2 /A)/^/4tt and, respectively, D = 0.9 and 
D = 0.25. In general, larger Z?'s imply faster convergence 
to the fixed-point. However, after a sufficient number of 
iterations, all the collapses we checked are almost perfect. 
One may wonder if Eq. (J9j) remains valid for more gen- 
eral forms of pi . A first extension of the above results can 
be obtained by considering single variable PDF's with 
two symmetric peaks, which, e.g., could be relevant for 
magnetic or diffusive phenomena. In this case p\ is not 
strictly positive anymore, so that a continuation of the 
generalized multiplication to negative values is required. 
One can indeed find a continuation that preserves the 
isomorphism with the ordinary multiplication [i"2| . We 
verified [12[ that while Eq. ([9]) remains valid asymptoti- 
cally, for this new class of pi 's positivity problems of the 
iterated PDF's can arise during the initial stages of the 
convergence process. 

In all examples, only the constraint a = 2 and, possi- 
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FIG. 2: Rescaled plots of p x with D = 0.25, N = 2 k , k = 
0,1,..., 22: (a) and (b). Comparison with Fig. Q] indicates 
slower convergence when D is smaller. 



bly, positivity requirements, pose limitations on the do- 
main of attraction of the stable PDF. This universality, 
typical of the CLT, is a consequence of the multiplicative 
structure in Eq. Indeed, in Eq. @ normalization 

(pjv(0) = 1® N = 1), centering (J^ yp N (y)dy = 0), and 

variance (J^^ y 2 PN(y)dy = cr 2 — 2) are conserved, as 
in the independent case. Thus, the trajectory described 
by Pn in function space differs substantially from a typ- 
ical RG flow, in which the variance is not conserved and 
relevant scaling fields determine the critical surface [l(|. 
Here, relevant fields are not present [l6| and the result 
in Eq. ^ identifies at least a subset of the universal- 
ity domain of the assumed asymptotic anomalous scaling 
specified by g and D. A further feature of our findings is 
that the choice of g does not imply a selection on admis- 
sible values of D, and vice- versa. This appears consistent 
with the variety of different anomalous scaling functions 
and exponents observed in natural phenomena [l7| . 

A basic issue is that of identifying an explicit mecha- 
nism by which correlations are introduced by the <g> mul- 
tiplication. Let us consider the normalized partial sums 
Yi = E^/W2) D and Y 2 = EIn/2 + i ^/(N/2) D . 
The correlations between Y\ and Y% are fully specified 
once their joint PDF p N (yi, y 2 ) is given. The knowledge 

(2) 

of pn alone does not allow to determine p N in general 

(2) 

since many p N are such to satisfy the obvious condi- 
tion^^) = J^P ( n (2/1,2/2) 5{y-yi -2/2) dy 1 dy 2 - So, 
many different correlation patterns are compatible with 
the anomalous scaling of p^- Eq. asymptoti- 
cally fixes p%\k/2 D ,k/2 D ) - g{k/2 D )®g{k/2 D ) 1 where 

(2) (2) 
p N is the FT of p N . In the independent case this 

last result would hold with g Gaussian, D = 1/2 
and the standard multiplication replacing (8. Fur- 
thermore, p^ ) (fc 1 /2 1 /2 ; / C2 /2 1 /2) „ g (k 1 /2 1 / 2 )g(k 2 /2 1 / 2 ) 

would clearly hold in that case also for k\ ^ k 2 , so that 

(2) 

p N would be fully specified in terms of g. It is natu- 
ral to ask if, under suitable assumptions, an analogous 
factorization of p N with k\ ^ k 2 holds in terms of the 
® multiplication also in the correlated case. This prop- 
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erty would imply the possibility of expressing the cor- 
relations determining the anomalous scaling in terms of 
Pm alone. It can be shown [l2j that such a factoriza- 

(2") 

tion is indeed possible if additional symmetries of p N 
are assumed, like the vanishing of linear correlations be- 
tween Yi and Y 2 , J*™ yiy 2 (VuV^) dyidy 2 = 0. This 
vanishing does not hold for other stochastic processes 
possessing anomalous scaling considered in the literature, 
like for example the fractional Brownian motion [l8| . Be- 
cause of market efficiency the vanishing of linear correla- 
tions characterizes, e.g., financial time series, where pn is 
the PDF of the normalized return of an index in time N . 
For such series we were able to show [l2j that the asymp- 

~(2) 

totic form of p N can be uniquely determined starting 
from pn and using a ® multiplication. The agreement 
of the theoretical predictions with the empirically sam- 
pled pff is quite remarkable [lS^ |. Thus, the generalized 
multiplication operation defined above is also a key for 
the full characterization of a relevant class of stochastic 
evolution processes. 

One can also establish a connection between the 
present CLT and anomalous diffusion. Let us consider 
a single variable PDF of the form pi(x) = [S(x — A) + 
6(x + A)]/2, and define a time t = Nr. Here, releasing 
the condition a 2 = 2, A and r are, respectively, the space 
and time span of random steps, and t is the time at which 
the iV-th step occurs. In the continuum limit N — > oo, 
r -> 0, A -> 0, such that t and V 1 / 20 = A 1 / d /t remain 
finite, one recovers [12] limN^oo[pi(k)]® N = p(k,t) = 
£>[p(k' wnere p{k,t) satisfies the standard Levy 
diffusion equation [h| 

*2 = -^M). «io, 



Assuming p(x,0) = 6(x), one gets the solution 
p(k,t) = exp(-V 1 / 2D \k\ 1 / D t/2 1 / 2D ), which corresponds 
to p(k,t) = g(V l / 2 kt D ) = 1 - Vk 2 t 2D /2 + 0(V 2 kH iD ). 
Hence, {x 2 ){t) = Vt 2D Thus, correlated sub- 

(D < 1/2) and super- (D > 1/2) diffusive solutions can 
be obtained through our mapping from the propagator 
of the uncorrelated Levy diffusion Eq. (10). This en- 
ables the description of the evolution towards the asymp- 
totic anomalous diffusion regime (analogous to Figs. I1I2|) 
without introducing a broad distribution of waiting times 
elapsing between successive steps as it is done in the con- 
tinuous time random walk approach 0, H3| ■ 

In summary, assuming anomalous scaling (Eqs. HOI)) 
we have constructed a multiplicative functional identity 
for the CF of the asymptotic sum of strongly correlated 
random variables which allowed the definition of a gener- 
alized multiplication. An isomorphism between this mul- 
tiplication and the ordinary one leads to establish a CLT 
in which the anomalous scaling represents the asymp- 
totic limit. Thus, for a given asymptotic anomalous scal- 
ing form we have characterized a large class of processes 
falling in the corresponding universality domain. In par- 
ticular cases our strategy also allows a full determination 
of the joint probabilities, and thus of the correlations of 
partial sums of the random variables [12] ]. In the con- 
text of stochastic processes, the presence of correlations 
implies that past events have an influence on the future 
behavior. The knowledge of the joint probability of con- 
secutive events (like Y\ and Y 2 ) hence entails a predictive 
power which has been recently exploited in finance [l2j . 
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